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DETAILED ACTION 

1 . This office action is responsive to communications filed on 02/23/2009. 
Claims 1-3 and 6-44 are pending and have been examined. 

Claim Rejections - 35 USC § 103 

2. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

3. The factual inquiries set forth in Graham v. John Deere Co., 383 U.S. 1 , 148 
USPQ 459 (1966), that are applied for establishing a background for determining 
obviousness under 35 U.S.C. 103(a) are summarized as follows: 

1 . Determining the scope and contents of the prior art. 

2. Ascertaining the differences between the prior art and the claims at issue. 

3. Resolving the level of ordinary skill in the pertinent art. 

4. Considering objective evidence present in the application indicating 
obviousness or nonobviousness. 

4. Claims 1-3, 6-12, 14-16, 23-25, 33, 35-36 and 43-44 are rejected under 35 
U.S.C. 103(a) as being unpatentable over Pizano et al (Patent no.: US 6,105,055) in 
view of Zhu et al. (PGPUB: US 2003/0182375 A1). 

With respect to claim 1, Pizano teaches a method for multimedia collaboration 
between a plurality of users including a host of a collaboration event, comprising the 
steps of: 
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storing a user interface in a memory location commonly accessible to said users 
(Pizano: fig. 1, col. 2, lines 32-60); 

selecting a source document using the user interface (Pizano: col. 4, lines 7-16); 

selecting a page from the selected source document using the user interface 
(Pizano: col. 4, lines 7-16); 

adding an annotation to a designated part of each of the selected pages using 
the user interface (Pizano: col. 4, lines 17-26); and 

combining the annotated pages into a collaboration document using the user 
interface (Pizano: col. 4, lines 27-67). 

However, Pizano does not explicitly teach a method of selecting a plurality of 
source documents using the user interface for multimedia collaboration between a 
plurality of users. 

In the same field of endeavor, Zhu teaches a method of selecting a plurality of 
source documents using the user interface for multimedia collaboration between a 
plurality of users (Zhu: page 3, paragraph 72, page 4, paragraph 84 and page 5, 
paragraphs 93, noted the conversion module that is capable of converting the shared 
document into a Rich Multi-media format for the plurality of users). 

Therefore, it would have been obvious to a person of ordinary skill in the art at 
the time of the invention to incorporate the method of selecting and converting a 
plurality of source documents into a Rich Multi-media format for the plurality of users as 
taught by Zhu in Pizano's invention in order to enable a plurality of users to collaborate 
the various different types of documents (Zhu: page 1 , paragraphs 8-9). 
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With respect to claim 2, Pizano teaches the method for multimedia collaboration 
as recited in claim 1, wherein said adding the annotation comprises adding a voice 
annotations or textual annotation (Pizano: abstract). 

However, Pizano does not explicitly teach a method of adding highlights to 
specific regions. 

In the same field of endeavor, Zhu teaches a method of adding highlights to 
specific regions (Zhu: page 13, Table 9, noted the Highlighter Tool). 

Therefore, it would have been obvious to a person of ordinary skill in the art at 
the time of the invention to incorporate the method adding highlights to specific regions 
as taught by Zhu in Pizano's invention in order to add more features to allow the 
conference administrator in expressing his/her ideas with regard to the content of the 
document. 

With respect to claim 3, Pizano teaches the method for multimedia collaboration 
as recited in claim 2, wherein said adding the annotation comprises adding one of 
dynamic and static annotations (Pizano: col. 2, lines 61-66). 

With respect to claim 6, Pizano teaches the method for multimedia collaboration 
as recited in claim 1 , wherein said adding the annotation comprises a adding a video file 
(Pizano: col. 4, lines 17-26). 

With respect to claim 7, Pizano teaches the method for multimedia collaboration 
as recited in claim 1, wherein said adding annotation comprises adding a video clip 
(Pizano: col. 4, lines 17-26). 
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With respect to claim 8, Pizano teaches the method for multimedia collaboration 
as recited in claim 7, wherein said adding a video clip comprises selecting said video 
clip from a stored video file (Pizano: col. 4, lines 17-26). 

With respect to claim 9, Pizano teaches the method for multimedia collaboration 
as recited in claim 8, wherein said adding a video clip comprises adding hyperlinks to 
said video clip (Pizano: col. 4, lines 17-54). 

With respect to claim 10, Pizano teaches all of the claimed limitations, except 
that he does not explicitly teach a method of adding the annotations using browser 
based controls. 

In the same field of endeavor, Zhu teaches a method of adding the annotations 
using browser based controls (Zhu: page 11, paragraph 191). 

Therefore, it would have been obvious to a person of ordinary skill in the art at 
the time of the invention to incorporate the method of adding the annotations using 
browser based controls as taught by Zhu in Pizano's invention in order to effectively 
collaborate over long distances regardless of their location without the need to install 
extra software. 

With respect to claim 11, Pizano teaches the method for multimedia 
collaboration as recited in claim 1, further comprising: 

storing said collaboration document in said memory location commonly 
accessible to said users (Pizano: fig. 1 & 4, col. 4, lines 17-54); and 

sharing retrieval address information for said collaboration document with said 
users (Pizano: col. 4, line 55 to col. 5, line 25). 
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With respect to claim 12, Pizano teaches the method for multimedia 
collaboration as recited in claim 1, wherein said storing a user interface comprises 
sending said interface to one of: a Sharepoint content management system, an 
Interwoven content management system, file systems on different servers (Pizano: fig. 
4, col. 4, lines 27-54), or a local file system. 

With respect to claim 14, Pizano teaches the method for multimedia 
collaboration as recited in claim 1 1 , further comprising categorizing said collaboration 
document (Pizano: col. 4, lines 27-54). 

With respect to claim 15, Pizano teaches the method for multimedia 
collaboration as recited in claim 1 , wherein said collaboration document is further 
annotated using e-mail (Pizano: col. 4, lines 27-37). 

With respect to claim 16, Pizano teaches the method or multimedia collaboration 
as recited in claim 1 , wherein said collaboration document is further annotated utilizing 
rich multimedia messaging (Pizano: col. 4, lines 27-37). 

With respect to claim 23, Pizano teaches a method for multimedia collaboration 
between a plurality of users including a host of a collaboration event, comprising the 
steps of: 

storing a user interface in a memory location commonly accessible to said users 
(Pizano: fig. 1, col. 2, lines 32-60); 

selecting a source document using the user interface (Pizano: col. 4, lines 7-16); 

selecting a page from the selected source document using the user interface 
(Pizano: col. 4, lines 7-16); 
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adding an annotation to a designated part of each of the selected pages using 
the user interface (Pizano: col. 4, lines 17-26); 

combining the annotated pages into a collaboration document using the user 
interface (Pizano: col. 4, lines 27-67); 

storing said collaboration document in said memory location commonly 
accessible to said users (Pizano: fig. 1 & 4, col. 4, lines 17-54); 

sharing retrieval address information for said collaboration document with said 
users (Pizano: col. 4, line 55 to col. 5, line 25); 

making and locally storing further annotations to said collaboration document; 
and selectively sending at a desired time said further annotations to said collaboration 
document in said memory location commonly accessible to said users (Pizano: fig. 1 & 
4, col. 4, lines 17-54). 

However, Pizano does not explicitly teach a method of selecting a plurality of 
source documents using the user interface for multimedia collaboration between a 
plurality of users. 

In the same field of endeavor, Zhu teaches a method of selecting a plurality of 
source documents using the user interface for multimedia collaboration between a 
plurality of users (Zhu: page 3, paragraph 72, page 4, paragraph 84 and page 5, 
paragraphs 93, noted the conversion module that is capable of converting the shared 
document into a Rich Multi-media format for the plurality of users). 

Therefore, it would have been obvious to a person of ordinary skill in the art at 
the time of the invention to incorporate the method of selecting and converting a 
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plurality of source documents into a Rich Multi-media format for the plurality of users as 
taught by Zhu in Pizano's invention in order to enable a plurality of users to collaborate 
the various different types of documents (Zhu: page 1 , paragraphs 8-9). 

In regard to claim 24 the limitations of this claim are substantially the same as 
those in claim 2. Therefore the same rationale for rejecting claim 2 is used to reject 
claim 24. By this rationale claim 24 is rejected. 

In regard to claim 25 the limitations of this claim are substantially the same as 
those in claim 10. Therefore the same rationale for rejecting claim 10 is used to reject 
claim 25. By this rationale claim 25 is rejected. 

In regard to claim 33 the limitations of this claim are substantially the same as 
those in claim 1 . Therefore the same rationale for rejecting claim 1 is used to reject 
claim 33. By this rationale claim 33 is rejected. 

In regard to claim 35 the limitations of this claim are substantially the same as 
those in claim 23. Therefore the same rationale for rejecting claim 23 is used to reject 
claim 35. By this rationale claim 35 is rejected. 

In regard to claim 36 the limitations of this claim are substantially the same as 
those in claim 23. Therefore the same rationale for rejecting claim 23 is used to reject 
claim 36. Furthermore, Pizano also teaches the limitations: "selecting a collaboration 
mode for said collaboration event respecting said collaboration document, wherein said 
collaboration mode comprises any of said offline, near real time, real time, and 
disconnected modes" (Pizano: col. 3 line 29 to col. 4 line 6). 
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With respect to claim 43, Pizano teaches all of the claimed limitations, except 
that he does not explicitly teach a method wherein the plurality of source documents 
include at least two source documents of different data formats. 

In the same field of endeavor, Zhu teaches a method wherein the plurality of 
source documents include at least two source documents of different data formats (Zhu: 
page 3, paragraph 72, page 4, paragraph 84 and page 5, paragraphs 93). 

With respect to claim 44, Pizano teaches the method for multimedia 
collaboration as recited in claim 1, further comprising sending a Uniform Resource 
Locator (URL) linked to the collaboration document to at least one of the plurality of 
users using the user interface, wherein selection of the received URL by the user, 
enables the user to access the collaboration document using a local web browser 
(Pizano: col. 4, line 27 to col. 5 line 25, noted that the URL points to the location at 
which the actual annotation is stored, and the user retrieves and downloads the 
message with the browser). 

5. Claims 13 is rejected under 35 U.S.C. 103(a) as being unpatentable over Pizano 
et al (Patent no.: US 6,105,055) in view of Zhu et al. (PGPUB: US 2003/0182375 A1) 
and Johnson et al. (PGPUB: US 2003/0023679 A1). 

With respect to claim 13, the combined method of Pizano-Zhu teaches all of the 
claimed limitations, except that they do not explicitly teach a method of sharing retrieval 
address information comprises sending retrieval address information by e-mail. 
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In the same field of endeavor, Johnson teaches a method of sharing retrieval 
address information comprises sending retrieval address information by e-mail. 
(Johnson: page 5, paragraph 63 and page 6, paragraph 71). 

Therefore, it would have been obvious to a person of ordinary skill in the art at 
the time of the invention to incorporate the method of sending retrieval address 
information by e-mail as taught by Johnson in the combined method of Pizano-Zhu's 
invention in order to implement a cost effective system and since the method of using e- 
mail for communication is very common and well known. 

6. Claims 17-22, 26-32 and 34 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Pizano et al. (Patent no.: US 6,105,055) in view of Zhu et al. 
(PGPUB: US 2003/0182375 A1) and Ludwig et al. (Patent no.: US 6,437,818 B1). 

With respect to claim 17, Pizano teaches a method for multimedia collaboration 
between a plurality of users of a collaboration event, comprising the steps of: 

storing a user interface in a memory location commonly accessible to said users 
(Pizano: fig. 1, col. 2, lines 32-60); 

selecting a source document using the user interface (Pizano: col. 4, lines 7-16); 

selecting a page from each of the selected source documents using the user 
interface (Pizano: col. 4, lines 7-16); 

adding an annotation to a designated part of each of the selected pages using 
the user interface (Pizano: col. 4, lines 17-26); 
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combining the annotated pages into a collaboration document using the interface 
(Pizano: col. 4, lines 27-67); 

storing said collaboration document in said memory location commonly 
accessible to said users (Pizano: fig. 1 & 4, col. 4, lines 17-54); 

establishing a messaging conference amongst said plurality of users (Pizano: 
col. 3, line 29 to col. 4 line 6); and 

selectively making and locally storing further annotations to said collaboration 
document by sending further annotations for selected pages of the collaboration 
document through messages during the messaging conference (Pizano: col. 4, line 27 
to col. 5 line 14). 

However, Pizano does not explicitly teach a method of selecting a plurality of 
source documents using the user interface for multimedia collaboration between a 
plurality of users; and establishing an instant conferencing communication amongst 
plurality of users. 

In the same field of endeavor, Zhu teaches a method of selecting a plurality of 
source documents using the user interface for multimedia collaboration between a 
plurality of users (Zhu: page 3, paragraph 72, page 4, paragraph 84 and page 5, 
paragraphs 93, noted the conversion module that is capable of converting the shared 
document into a Rich Multi-media format for the plurality of users). 

Therefore, it would have been obvious to a person of ordinary skill in the art at 
the time of the invention to incorporate the method of selecting and converting a 
plurality of source documents into a Rich Multi-media format for the plurality of users as 
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taught by Zhu in Pizano's invention in order to enable a plurality of users to collaborate 
the various different types of documents (Zhu: page 1 , paragraphs 8-9). 

However, the combined method of Pizano-Zhu does not explicitly teach a method 
of establishing an instant conferencing communication amongst plurality of users. 

In the same field of endeavor, Ludwig teaches a method of establishing an 
instant conferencing communication amongst plurality of users (Ludwig: fig. 1 -2, col. 6, 
lines 7-41 , noted the collaborative multimedia workstation). k 

Therefore, it would have been obvious to a person of ordinary skill in the art at 
the time of the invention to integrate the collaborative multimedia workstation as taught 
by Ludwig in the combined method of Pizano-Zhu's invention in order to greatly facilitate 
distributed collaboration, in part by replicating the benefits of face-to-face collaboration 
(Ludwig: col. 3, lines 2-7). 

With respect to claim 18, Pizano teaches the method for multimedia 
collaboration as recited in claim 17, wherein said adding the annotation is repeatedly 
performed by any of said users and results thereof are overlaid and stored (Pizano: col. 
5, lines 15-46). 

With respect to claim 19, Pizano teaches the method for multimedia 
collaboration as recited in claim 17, wherein said adding the annotation includes 
selectively annotating one of animation, graphics, voice, or video (Pizano: col. 4, lines 
17-26). 
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With respect to claim 20, Pizano teaches all of the claimed limitations except that 
he does not explicitly teach a method of establishing an instant messaging conference 
includes establishing voice conferencing. 

In the same field of endeavor, Ludwig teaches a method of establishing an 
instant messaging conference includes establishing voice conferencing (Ludwig: fig. 1- 
2, col. 6, lines 7-41). Same motivation used in claim 17 applies equally as well to claim 
20. 

With respect to claim 21, Pizano teaches all of the claimed limitations except that 
he does not explicitly teach a method of establishing instant messaging conference 
includes establishing video conferencing. 

In the same field of endeavor, Ludwig teaches a method of establishing instant 
messaging conference includes establishing video conferencing (Ludwig: fig. 1-2, col. 6, 
lines 7-41 ). Same motivation used in claim 1 7 applies equally as well to claim 21 . 

With respect to claim 22, Pizano teaches a method for multimedia collaboration 
as recited in claim 17, wherein said the collaboration document is created in 
conformance with needs of said users and applicable confidentiality and security 
requirements (Pizano: col. 3 line 34 to col. 4 line 6). 

In regard to claim 26 the limitations of this claim are substantially the same as 
those in claim 17. Therefore the same rationale for rejecting claim 17 is used to reject 
claim 26. By this rationale claim 26 is rejected. 

With respect to claim 27, Pizano teaches the method for multimedia 
collaboration as recited in claim 26, wherein said step of said first user selecting a 
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document comprises selecting a document from any of a server, a data repository, a 
shared portal, disk storage, a database, and the Web (Pizano; fig. 1 , col. 2, lines 32-60). 

With respect to claim 28, Pizano teaches the method for multimedia 
collaboration as recited in claim 26, wherein said step of said first user optionally 
associating user-entered data with said document page comprises a step of associating 
any of voice and graphic annotations (Pizano: col. 2, line 61-66, col. 4, lines 1 7-26). 

With respect to claim 29, Pizano teaches the method for multimedia 
collaboration as recited in claim 26, wherein said step of said first user optionally 
associating user-entered data with said document page comprises a step of associating 
audio and graphic annotations and a step of streaming said audio synchronously along 
with said graphic annotations (Pizano: col. 4, lines 17-27 and col. 6, lines 17-28). 

With respect to claim 30, Pizano teaches the method for multimedia 
collaboration as recited in claim 26, wherein said step of saving said document page 
comprises saving said document page in a format requiring only a regular web browser 
to view said annotated documents (Pizano: col. 5, lines 15-25). 

With respect to claim 31, Pizano teaches a method for multimedia collaboration 
as recited in claim 26, wherein said step of saving said document page comprises 
saving said document page with a URL (Universal Resource Locator) in an Internet 
information server (Pizano: col. 4, lines 27-37). 

However, Pizano does not explicitly teach a method of establishing instant 
message communication comprises said first user communicating said URL to said 
second user using the instant message communication. 
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In the same field of endeavor, Zhu teaches a method of establishing instant 
message communication comprises said first user communicating said URL to said 
second user using the instant message communication (Zhu: page 10, paragraphs 165, 
178). 

Therefore, it would have been obvious to a person of ordinary skill in the art at 
the time of the invention to incorporate the method of establishing instant message 
communication comprises said first user communicating said URL to said second user 
using the instant message communication as taught by Zhu in the Pizano's invention in 
order togreatly facilitate distributed collaboration, in part by replicating the benefits of 
face-to-face collaboration. 

With respect to claim 32, Pizano teaches the method for multimedia 
collaboration as recited in claim 26, wherein said step of creating a composite document 
comprises creating said composite document in conformance with needs of said users 
and applicable confidentiality and security requirements (Pizano: col. 3 line 34 to col. 4 
line 6). 

In regard to claim 34 the limitations of this claim are substantially the same as 
those in claim 17. Therefore the same rationale for rejecting claim 17 is used to reject 
claim 34. By this rationale claim 34 is rejected. 

7. Claims 37-42 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Pizano et al (Patent no.: US 6,105,055) in view of Zhu et al. (PGPUB: US 
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2003/0182375 A1) and further in view of Eintracht et al. (Patent no.: US 6,687,878 
B1). 

With respect to claim 37, the combined method of Pizano-Zhu teaches all of the 
claimed limitations except that they do not explicitly teach a method of generating and 
storing a log of collaboration. 

In the same field of endeavor, Eintracht teaches a method of generating and 
storing a log of collaboration (Eintracht: col. 2 lines 25-28, and col. 3, lines 37-44). 

Therefore, it would have been obvious to a person of ordinary skill in the art at 
the time of the invention to incorporate the method of generating and storing a log of 
collaboration as taught by Eintracht in the combined method of Pizano-Zhu's invention 
in order to keep a transaction history of all event for notes (Eintracht: col. 3 line 37-44). 

With respect to claim 38, Pizano teaches the method for multimedia 
collaboration as recited in claim 36, wherein said selecting a collaboration mode 
comprises selecting a single one of said offline, near real time, real time, and 
disconnected modes (Pizano: col. 3 line 29 to col. 4 line 6). 

With respect to claim 39, Pizano teaches the method for multimedia 
collaboration as recited in claim 36, wherein said selecting a collaboration mode 
comprises selecting a plurality of said offline, near real time, real time, and disconnected 
modes (Pizano: col. 3 line 29 to col. 4 line 6). 

In regard to claims 40-42 the limitations of these claims are substantially the 
same as those in claims 37-39. Therefore the same rationale for rejecting claims 37-39 
is used to reject claims 40-42. By this rationale claims 40-42 are rejected. 
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Response to Arguments 

8. Applicant's arguments with respect to claims 1-3 and 6-44 have been considered 
but are moot in view of the new ground(s) of rejection. 

Conclusion 

9. Applicant's amendment necessitated the new ground(s) of rejection presented in 
this Office action. Accordingly, THIS ACTION IS MADE FINAL. See M PEP 

§ 706.07(a). Applicant is reminded of the extension of time policy as set forth in 37 
CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the date of this final action. 

1 0. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to LIN LIU whose telephone number is (571)270-1447. 
The examiner can normally be reached on. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Vivek Srivastava can be reached on (571)-272-7304. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/Lin Liu/ /Patrice Winder/ 

Examiner, Art Unit 2445 Primary Examiner, Art Unit 2445 



